REPETITION IN REDUCED DECOMPOSITIONS 
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Abstract. Given a permutation w, we show that the number of repeated letters in a re- 
duced decomposition of w is always less than or equal to the number of 321- and 3412-patterns 
appearing in w. Moreover, we prove bijectively that the two quantities are equal if and only 
if w avoids the ten patterns 4321, 34512, 45123, 35412, 43512, 45132, 45213, 53412, 45312, 
and 45231. 
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1. Introduction 

Permutations can be described in a variety of ways, including as a product of simple 
reflections and in one-line notation. These two were studied extensively by the author in |10j . 
and a means for translating properties of one presentation into properties of the other was 
given. The first of these presentations is most relevant to the generalized setting of Coxeter 
groups and the Bruhat order. There is a rich literature studying various properties of reduced 
decompositions, including pQ and [7]. The second of these presentations, one-line notation, 
is primarily useful when discussing the notion of permutation patterns. This topic originated 
in work of Rodica Simion and Frank Schmidt |5j, and has become a popular subfield of 
combinatorics. 

Given any permutation w, one can calculate its length, and one can also calculate the 
number of distinct simple reflections that appear in any reduced decomposition of w. The 
difference between these two quantities, denoted rep{w) in this paper, would thus count the 
number of repeated letters in any reduced decomposition of w. These statistics are readily 
computed from the presentation of a permutation as a product of simple reflections. 

When written in one-line notation, one often looks at the patterns in (or not in) a per- 
mutation. In particular, one can count the number of distinct 321- and 3412-patterns in a 
permutation w, and this total will be denoted [321;3412](i(;) here. 

It was shown in previous work by the author that rep{w) = if and only if [321;3412](i(;) = 
[9]. Additionally, Daniel Daly shows that rep{w) = 1 if and only if [321;3412](i(;) = 1 |3]. 
Other than these results, not much has been known about the quantity or type of repetition 
that might occur within a reduced decomposition of a given permutation. 

The ideal conclusion based on the results of [9J and [3J, that rep(w) and [321;3412](i(;) 
would always be equal, is not actual the case, as can be seen with rep(4321) = 3 and 
[321;3412](4321) = 4. However, the main result of this paper (Theorem 13.21) is that rep{w) is 
always less than or equal to [321;3412](w), and the two quantities are equal exactly when w 
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avoids each of the patterns 

{4321, 34512, 45123, 35412, 43512, 45132, 45213, 53412, 45312, 45231}. 

Moreover, in Corollary 15.31 we give a crude lower bound on the difference [321;3412](«;) — 
rep{w) when w contains some of the patterns listed above. 

In Section |2]of the paper, we introduce the necessary objects and terminology for this work. 
Section [3] suggests the relevance of the ten patterns listed above and states the main theorem, 
while the proof of this theorem is spread over Sections H] and |5l 

2. Definitions 

This section summarizes the primary objects studied in this work. More background on 
this material can be found in [1] and [1]. 

Let <Sn be the symmetric group on n elements. The group is generated by the simple 
reflections (also called adjacent transpositions) {si, . . . , where Si is the permutation 

interchanging i and i + 1, and fixing all other elements. These permutations satisfy the 
Coxeter relations 

sf = 1 for all i, 

SiSj = SjSi if \i — j\ > 1, and 

SiSi+iSi = Si+iSiSi+i for 1 < i < n - 2. 

As is customary, a map acts to the right, meaning that SiW interchanges the positions of the 
values i and z + 1 in the one-line notation of w, and wsi interchanges the values in positions 
i and « + 1 in the one-line notation of w. 

A permutation w G &n can also be written in one-line notation as w = w{l)w{2) ■ ■ - win). 

Example 2.1. The permutation 3241 G ©4 maps 1 to 3, 2 to itself, 3 to 4, and 4 to 1. 

We have now described two substantially different presentations for permutations: products 
of simple reflections and one-line notation. A means of translating between these two, and of 
inferring properties of one from properties of the other, was given in [10]. 

Definition 2.2. If w = ■ ■ ■ Sj^^^j where £{w) is minimal, then ■ ■ ■ Si^j^j is a reduced 
decomposition (or reduced word) of w. This £{w) is the length of w. 

The set of reduced decompositions of a permutation has been studied from several view- 
points, including connections to Young tableaux as described in [7]. In this paper, we will 
study repetition among the letters in a reduced decomposition of a permutation. To that 
end, we make the following definition. 

Definition 2.3. Given a permutation w, the support of w is the set supp(tf ) of distinct letters 
appearing in a reduced decomposition of w. 

It is important to clarify why this definition is sound. 

Lemma 2.4. The set supp(t/;) is well defined. 

Proof. We must prove that the set of letters in a reduced decomposition of a permutation is 
independent of the particular reduced decomposition chosen as a representative. Any reduced 
decomposition of w can be obtained from any other by a series of Coxeter relations |2] . These 
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do not change the underlying set of distinct letters in the reduced decomposition, so the set 
supp(i(;) is well defined. That is, given any reduced decomposition w = ■ ■ ■ Si^, 

supp(^^;) = {si^, . . . , SiJ. 

□ 

Example 2.5. Let w = 32154 G ©5. One reduced decomposition for w is S2S1S2S4, so 
supp(i(;) = {51,^2,54}. Note that S2S1S4S2 and S1S2S1S4 are also reduced decompositions for 
w, and they each yield the same set supp(w). 

The following statistics will be crucial in our proof of the main theorem. 

Definition 2.6. Fix w e and k E {1, . . . ,n — 1}. Let 

Mk{w) = max{u'(l), . . . , w{k)} 

and 

"mkiw) = mm{w{k + 1), . . . , w{n)}. 
Lemma 2.7. For any w G &n, the values of Mk{w) saiisfy 

Mi{w) < M2H < MsH < • • • < M„_iH, 
and the values of mk{w) satisfy 

mi{w) < m2{w) < m^{w) < ■ ■ ■ < m„_i(t(j). 

We have strict inequality Mk{w) < Mk+iiw) exactly when w{k-\- 1) > Mk{w), and mk{w) < 
vrik+iiw) exactly when w{k + 1) < mk+i{w). 

Proof. These inequalities follow immediately from the definitions of Mk{w) and mk{w). □ 
The next lemma is a consequence of the definition of the support of a permutation. 

Lemma 2.8. Fix a permutation w G 6„. The following statements are equivalent: 

• Sfc G supp(m;), 

. {w{l),...,w{k)}j^{l,...,k}. 

• {w{k + 1), . . . ,w{n)} ^ {k + 1, . . . ,n}, 

• Mk{w) > k, 

• mk{w) < k+1, and 

• Mk{w) > mk{w). 

Proof. Suppose that s^ G supp(t«). This means that Sk appears at least once in each reduced 
decomposition of w, which means that there is some inversion w{i) > w{j) in where 
i < k < j. Thus the set {w{l), . . . , w{k)} cannot equal {!,..., k}, and, equivalently, the set 
{w{k + l), . . . , w{n)} cannot equal {k + 1, . . . , n}. Also equivalently, the set {w{l), . . . , w{k)} 
contains an element larger than k, and, equivalently, the set {w{k + 1), . . . ,w{n)} contains 
an element less than k + 1. 

If, on the other hand, Sk ^ supp(w), then there is no inversion such as described in the pre- 
vious paragraph. Therefore w{l) ■ ■ ■ w{k) is a permutation of {1, . . . , A;} and w{k + 1) ■ ■ ■ w{n) 
is a permutation of {/c + 1, . . . , n}. Thus Mk{w) — k and mk{w) — k + 1. □ 

In this paper, we will study the relationship between two statistics of a permutation. The 
first of these is related to the support of a permutation. 
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Definition 2.9. Given a permutation w, let rep{w) be the quantity 
(1) rep{w) = i{w) — \supp{w)\. 

This quantity is so named because it counts the number of simple reflections in a reduced 
decomposition of w, when reading from one end to the other, which repeat previously seen 
letters. The fact that this latter description is well defined may not be immediately obvious, 
given that a permutation may have more than one reduced decomposition. However, this does 
not affect supp(i(;), as shown by Lemma [231 a.nd so rep(w) is well defined, by equation ([1]). 

Example 2.10. Let w = 35412, where i{w) = 7 and supp(iy) = {si, S2, S3, S4}. Thus 
rep(w) = 7 — 4 = 3. Relatedly, one reduced decomposition for w is S2S1S3S2S4S3S2, and 
reading from left to right we encounter the repeated simple reflections which are marked in 



S2 



S4 



S3 



S2 



S2S1S3 

There are three such letters, so rep{w) = 3. 

The other statistic we will consider relates to permutation patterns. 

Definition 2.11. Let w G (3„ and p G &k for k < n. The permutation w contains the 
pattern p if there exist ii < ■ ■ ■ < such that w{ii) ■ ■ ■ w{ik) is in the same relative order as 
p{l) ■ ■ -pik), in which case w{ii) ■ ■ ■ w{ik) is an occurrence of p in w. For notational clarity, 
we will sometimes denote this pattern by {w{ii), . . . , w{ik)}. If N = max{w(zi), . . . , w{ik)}, 
then this w{ii) ■ ■ ■'w{ik) is an N -occurrence of p. If w does not contain p, then w avoids p, 
or is p-avoiding. 

The set of all occurrences of a pattern p in a permutation w can be partitioned by the 
largest letter appearing in the occurrence: 

{occurrences of p in w} = | |{A^-occurrences of p in w}. 

N 

Example 2.12. Continuing Example 12. 101 there are two occurrences of 3412 in w: 3512 and 
3412. The first of these is a 5-occurrence, and the second is a 4-occurrence. The permutation 
w is 123-avoiding because it has no increasing subsequence of length 3. 

There is much interest in enumeration related to permutation patterns. The portion of 
this scholarship relevant to the current work is the enumeration of occurrences of a pattern 
p appearing in a permutation w. 

Definition 2.13. Given a permutation w and a pattern p, let [p];v(u') denote the number of 
A^-occurrences of p in w. Let 

[p]H = E[p]^w 

N 

be the total number of occurrences of p in w. 

Example 2.14. Continuing Example I2.10[ we have [321]5(t(;) = 2 and [321]^(w) = for all 
i ^ 5. Also, [3412]4(u;) = [3A12]^{w) = 1, and [3412].(«;) = otherwise. 

For reasons that will be suggested by Theorem I2.17[ we are most concerned with the 
patterns 321 and 3412, and we will count the number of distinct occurrences of these patterns. 
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Definition 2.15. Given a permutation w, and a positive integer A^, let 



[321;3412]^(m;) 



[321]^(^) + [3A12Uw). 



Let [321;3412](to) be the quantity 



(2) 



[321;3412](w) 



[321](«;) + [3412] («;) 



N 



Example 2.16. Continuing Example l2.im let us calculate [321;3412](ty). The distinct occur- 
rences of 321 in w are {541, 542}, and the distinct occurrences of 3412 in w are {3512, 3412}. 



Using the notation defined above, the following results were shown previously, the first by 
the author and the second by Daniel Daly. 

Theorem 2.17 ([9J and [3J). For any permutation w, 

(a) rep(iD) = if and only i/ [321;3412](to) = 0, and 

(b) rep(wj) = 1 if and only if [321;3412](zw) = 1. 

Theorem 12. 171 gives a clear indication that the statistic rep is related to whether a permu- 
tation contains the patterns 321 or 3412. This arises from the previously mentioned work by 
the author in [10], relating patterns (and hence the one-line presentation of a permutation) 
with the presentation of a permutation as a product of simple reflections. 

The statistics rep and [321;3412] are not always equal, as shown by Examples I2.10l and l2.16l 



In this paper, we will show that rep(«;) never exceeds [321;3412](iy), and we will characterize 
equality of the two quantities by pattern avoidance. 



Rather surprisingly, the potential equality of the statistics rep and [321;3412] mentioned at 
the end of the last section depends solely on the avoidance of ten patterns, the set of which 
we will denote $. 

Definition 3.1. Let 

$ = {4321,34512,45123,35412,43512,45132,45213,53412,45312,45231} C (©4U©5). 

To suggest the relevance of the set let us compare rep((/)) and [321;3412](0) for all 
writing rep((/)) as the difference ^(0) — |supp(0)|, and [321;3412](0) as the sum [321](0) -|- 



Thus 



[321;3412]4H = + 1 = 1, 
[321;3412]5(V;) = 2 + 1 = 3, and 
[321;3412]('u;) = 2 + 2 = 1 + 3 = 4. 



rep(35412) < [321;3412](35412). 



3. The main theorem 
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[3412] ((^) in equation 



G $ I rep(0) I [321;3412]((/)) 



4321 6-3 = 3 4 + = 4 

34512 6-4 = 2 + 3 = 3 

45123 6-4 = 2 + 3 = 3 

35412 7-4 = 3 2 + 2 = 4 

43512 7-4 = 3 2 + 2 = 4 

45132 7-4 = 3 2 + 2 = 4 

45213 7-4 = 3 2 + 2 = 4 

53412 8-4 = 4 4+1 = 5 

45312 8-4 = 4 4+1 = 5 

45231 8-4 = 4 4+1 = 5 



Observe that for each G $, we have rep(0) < [321;3412](0). 
We are now able to state the main theorem of the paper. 



Theorem 3.2. // a permutation w avoids every pattern in the set $, then 



rep{w) = [321;3412]H. 




This characterization of equahty between rep and [321;3412] if and only if the set $ is 
avoided is recorded in entry P0022 of the Database of Permutation Pattern Avoidance [8], 
and is enumerated by A 19 1721 in [6]. 

Observe that Theorem 13.21 recovers the result in Theorem 12.171 since a permutation w in 
which [321;3412](w) G {0,1} necessarily avoids every pattern in $. Note also that and 1 
are the only values for which rep{w) and [321;3412](t(;) are necessarily equal, because there 
are permutations G $ with rep(0) = 2 but [321;3412](0) = 3. 

Suppose w E &N- Theorem 13.21 is proved by induction on N and involves an assignment of 
at least one iV-occurrence of 321 or 3412 to each previously used letter involved in positioning 

in the one-line notation of w, after first positioning all other letters relative to each other. 
We must be wary of overcounting these A-occurrences of 321 and 3412. The details of the 
proof are covered in Sections H] and O 



The one-line notation of w is obtained from the one-line notation of w by deleting the letter 
A and sliding all subsequent letters one space to the left. Moreover, if we think of u; as a 
permutation in ©at that fixes A, then 



4. Preliminaries for proving the main theorem 



Definition 4.1. Consider w G &n- Define w G &n~i by 




w{i) if i < w ^(A), and 
w{i + l) ifi>w~^(A). 



(3) 



W = WSn-1SN-2 ■ ■ ■ Sw-i(N), 
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and 

i{w) = i{w) + N -w-\N). 

Example 4.2. li w = 35412, then w = 3412. If we consider w to be the element 34125 G 65, 
then 

W = WS4S3S2. 

One reduced decomposition of I(J is S2S1S3S2, and so S2S1S3S2S4S3S2 is a reduced decomposition 
of w. 

Throughout the rest of this section, let w he a. permutation in &n, and w G &n-i be as 
defined above. 

The following set will be crucial in the proof of Theorem 13. 2[ describing the letters in a 
reduced word of w, but not of W, which count as repeated letters for w. 

Definition 4.3. Let new-rep(w) = {A; : Sk G supp(ly) and w~^{N) < k}. 

Lemma 4.4. 

rep(«;) = rep(ll;) + |supp(«;) n {siv_iSAr_2 • • • s,„-i(7v)}| 
= rep(«;) + |new-rep(t(7)|. 

Proof. This follows from equation ([3]). □ 

Recall the functions and nik from Definition 12.61 

Lemma 4.5. If Mk{w) > mkiw) and w~^{N) < k, then k G new-rep(ty). 

Proof. This is immediate from the definition of ne\N-rep{w) . □ 

To show that rep(w) is a lower bound for [321;3412](t(;), we would like to assign, to each 
element of ne\N-rep{w) , at least one A^-occurrence in w of one of the patterns {321, 3412}. This 
assignment should be done carefully to avoid overcounting. Additionally, to characterize when 
rep(w) and [321;3412](t(;) are equal, we would like to understand when each A^-occurrence in 
w of the patterns {321,3412} corresponds to some element of ne\N-rep{w). 

For the remainder of this section, set = Mkiw) and mu = rnk{w) for all k. 

Definition 4.6. Consider k G new-rep(w). Define pkiw) as follows. 

1. If w^^{N) < w~^{Mk), then pk{w) = {N, Mk,mk}, which is a 321-pattern in w. 
II. If w~^{N) > w~^{Mk) and w{k) > ruk, then pk{w) = {N,w{k),mf:}, which is a 
321-pattern in w. 

III. Otherwise, set pk{w) = {M^, N,W{k),mk}, which is a 3412-pattern in w. 
This pk{w) is undefined if A; ^ new-rep(w). 

Note that pk{w) is always an A^-occurrence of either 321 or of 3412 because k G new-rep(iy) 
and thus Mk > rrik by Lemma [2781 However, it is not clear when pk{w) and pk'{w) coincide 
for k 7^ k', nor which A^-occurrences of 321 or of 3412 have the form pkiw) for some k. 
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4.1. Issues of overcounting. Consider wlietlier tlie patterns pk{w) migiit overcount A^- 
occurrences of 321 or 3412 in w. 

Proposition 4.1.1. There are no distinct k,k' G new-rep(tt;) for which pkiw) andpk'{w) are 
the same N -occurrence o/3412 in w. 

Proof. If this were ttie case, tlien {Mk,W{k),mk) = {Mk',w{k'),mk'). But tlien w{k) = W(k'), 
implying tliat k = k'. □ 

Therefore, if there is any overcounting of A^-occurrences of 321 or 3412 among the {pkiw)}, 
it must be that pk{w) and pk'iw) are the same A^-occurrence of 321. 

Proposition 4.1.2. If there exist distinct k,k' G ne\N-rep{w) with pk{w) = pk>{w), then w 
has an N -occurrence o/4321. 

Proof. Suppose that there exist k,k' G new-rep(ty), with k < k', such that pkiw) = pk'{w). 
Proposition 14.1.11 implies that these coincident patterns must be A^-occurrences of 321 in w. 

These coincident pkiw) and pk'{w) cannot both be of type II as in Definition 14.61 because 
that would mean that w{k) = W{k'), and so A; = k'. 

Now suppose that one is of type I, and the other of type II. Thus w{k) = Mk' and = my. 
Then {N.,w{k) = Mk' ,w{k),mk = mk'} forms an A^-occurrence of 4321 in w. Note also in 
this case that we must have Mk = w{k) = Mk', since otherwise Mk would lie to the left of 
w{k) = Mk', and be greater than w{k) by definition, which would contradict the maximality 
ofMk'. 

It remains to consider the case when both patterns are of type I, and so {Mk,mk) = 
{Mk',mk') = {M,m). We can assume that M ^ {w{k),w{k')} because that case was already 
addressed. Then the one-line notation of w, and hence of w, looks like 

... ][f ... y7(/s) . . . w{k') ■ ■ ■ m ■ ■ ■ . 

Consider where A^ lies in relation to the values {M,w{k),w{k'),m}. Because both patterns 
have type I, we must have that w~^{N) < w~^{M), and so A^ lies to the left of M. The 
definitions of M and m require that M > w{k),w{k'), and m < W{k'). Thus the letters 
{A^, M,w{k'), m} form an A^-occurrence of 4321. □ 

Corollary 4.1.3. If w has no N -occurrence o/4321, then 

|new-rep(^i;)| < [321;3412]^H. 

Proof. This follows from Propositions 14.1.11 and I4.1.2| because there do not exist distinct 
k,k' G new-rep(to) with pkiw) equalling pk'{w). □ 

Therefore, by Corollary I4.1.3[ the procedure for assigning to each k G new-rep(iy) an A^- 
occurrence of either 321 or 3412 is injective if w has no A^-occurrence of 4321. We must now 
consider what happens to this assignment when w does have such a pattern. 

Proposition 4.1.4. Suppose that w has an N -occurrence o/ 4321. // there exist distinct 
k,k' G new-rep(w) and pkiw) = pk'{w), then there are two other N -occurrences Pk'{w) and 
Pk'{w) of 321 in w, which are not equal to pj{w) for any j. 
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Proof. Suppose that there are such k < k'. Then we know from Proposition 14.1.21 that 
{M^jTrik) = (Mfc/,mfc') = (M, m), and pk{w) = pk'{w) = {N,M,m}. Also, we know that the 
one-hne notation of w looks like 

... N ... M ■■■ w{k) ■ ■ ■ w{k') ■■■ m ■■■ , 

where M and w{k) could possibly be equal. Because M = Mk>, we must have M > W{k'). 
Also, because m = m^, we must have m < w{k'). Thus 

PI,{w) = {N > M > w{k')} and p^^iw) = {N > w{k') > m} 

are both A^-occurrences of 321 in w. 

Note that p^/(w) is not equal to pj{w) for any j, because w{k') is not equal to rrij for any j: 
there exists a letter (for example, m) to the right ofw{k') which is less than w{k'). Similarly, 
p^i{w) 7^ Pj{w) for any j, because w{k') cannot equal Mj. □ 

It is also helpful to note that for all k', the same reasoning as in Proposition 14. 1.41 implies 
that {p+H,p^,(«;)} n {pj{w),pj{w) : j ^ k'} = 0. 

Corollary 4.1.5. If w has an N -occurrence o/4321, then 

|new-rep(w;)| < [321;3412]^(w;). 

Proof. Partition the set n&N-re^iw) into sets Si, 82, . . . , St so that {Mk,mk) = {M{i),m{i)) 
for each k G Si. Suppose Si = {ki-^ < ki^ < ■ ■ ■ < h^^^}, and define 

Note that if \Si\ = 1, then |p5i(w)| = 1. Also, if \Si\ > 1, then |p5i(w)| = 2|S'i| - 1 > \Si\. 
Moreover, the elements of p5j(w) are all A^-occurrences of either 321 or 3412 in w. Finally, 
by design of the partition new-rep(w) = 5*1 U 5*2 U • ■ ■ , the sets {pSii^)} are disjoint. 

If w has an A-occurrence of 4321, then there exists some Si containing at least two ele- 
ments. Thus \nevj-rep{w)\ = \Si\ + |S'2| H h 15*41 < \ps^{w)\ + \ps2{u!)\ H h \psM\ < 

[321;3412]^(«;). □ 

Using the notation from the proof of Corollary 14.1.51 we can also rewrite its result to say 
that the map 



(4) Cn-.j^ 



is an injection. 



pj{w) if j is the minimal element in Si, and 
p^iw) otherwise. 



4.2. Issues of undercounting. We have now addressed the issue of whether the set {pk{w) : 
k G new-rep(to)} might overcount some A^-occurrences of 321 (never of 3412). We must 
now consider when this set might undercount these A^-occurrences. As we have seen in 
Proposition 14.1.41 undercounting is certainly a possibility. What we will show now is that if 
w avoids the ten patterns in the set $, then there is no undercounting, and thus the inequality 
of Corollary 14.1.31 is actually an equality. 

To examine potential undercounting, we must decide if and when an A^-occurrence of 321 
or of 3412 might not equal pk{w) for some k. 
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Proposition 4.2.1. // any N -occurrence {N > a > h] of 321 in w is such that b ^ {m^ : 
k G new-rep (i/;)}, then w has an N -occurrence 0/4321. 

Proof. Suppose there is an iV-occurrence of 321 in w where h ^ ruk for any k. Then to the 
right of h in the one-line notation there exists c < b, preventing b from equalhng any such 
nik- Thus {A^ > a > 6 > c} is an A^-occurrence of 4321. Now, suppose there is no such c, 
and set k = w^^{b) — 1. Then b = nik, and, since a > b appears to the left of b, we must have 
Mk > a > b = nik- Therefore, by Lemma [4.51 k G ne\N-rep{w). □ 

Proposition 4.2.2. Suppose w is ^321- avoiding. If any N -occurrence {N > a > b} of 321 

in w is such that there exists no k & ne\N-rep{w) with {a,b) G {{Mk,mk), {wk,rnk)}, then w 
has an N -occurrence of at least one of the patterns {45312, 53412}. 

Proof. By Proposition 14.2.11 we know that b = for at least one value of A; G new-rep(tf;). 
Suppose that a ^ {Mk,w{k)}. 

Suppose a > Mk. Then, by maximality of M^, this a must appear to the right of both Mk 
and w{k) in the one-line notation of w. But then, setting k' = w~^{a), we must have nik' = 
rUk = b, and so (a, b) = (w{k'),mk'). By definition, k' > k, and so rUk' = < k-\-l < k' -\-l, 
where the first inequality is because k G new-rep(w). Therefore k' G ne\N-rep{w) as well. 

Now suppose that a < M^. If w^^{N) > w~^{Mk), then the one-line notation of w looks 
like 

• • • Mk ■ ■ ■ N 0, b = rrik ■ ■ ■ , 

<a >a or <mj. 

because w is 4321-avoiding. If all values appearing between a and b in w are larger than a, 
then we can set k' = w~^{a), and we have (M^/, rrik') = (M^, m^), and again k' G new-rep(ty). 
Thus suppose that there is some value c in this portion of w with c < mk. Then {Mk, N, a, c, b} 
is an A^-occurrence of 45312 in w. 

Finally, suppose that w~^{N) < w~^{Mk), where k is minimal with this property. So the 
one-line notation of w looks like 

• • • ■ ■ ■ a ■ ■ ■ Mk ■ ■ ■ b = ruk ■ ■ ■ , 

again because w is 4321-avoiding. There must exist some c < nik between Mk and nik in 
the one-line notation for w preventing us from choosing a different value k' < k so that 
a G {Mk',w{k')} and nik' = nik- Such a k' would be in new-rep(tL') because a > b while 
{a, b} n {w{l), . . . ,w{k')} = {a}, so max{ly(l), . . . ,w{k')} > k'. Then {A^, a, Mk, c, mk = b} 
would form a 53412-pattern in w. □ 

Propositions I4.2.T] and 1^2.21 now imply the following result. 

Corollary 4.2.3. Ifw has no N -occurrences of the patterns {4321,45312,53412}, then every 
N -occurrence of 321 in w is equal to pfc(w) for some k. 

Proposition 4.2.4. // any N -occurrence {a, N, b, c} o/3412 in w is such that c {mk : k G 
new-rep(w)}, then w has an N -occurrence of at least one of the patterns {45231,45132}. 

Proof. Suppose there is such an A^-occurrence of 3412 in w. This means that to the right of 
c in the one-line notation of w, there exists a, d < c, preventing c from equalling any such 
mk- Thus {a, N, b, c, d} is an A^-occurrence of either 45231 or of 45132, depending on whether 
b > d or b < d. Now suppose that there is no such d, and set k = w~^{c) — 1. Then c = mk. 
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and, since a > c appears to the left of c, we must have Mk > rrik. Therefore, by Lemma [4.51 
k E ne\N-rep{w). □ 

Proposition 4.2.5. Suppose w is 45231- and 4:5132-avoiding . If any N -occurrence {a, A^, 6, c} 
o/3412 in w is such that there exists no k E new-rep(ty) with (a, c) = {Mk,mk), then w has 
an N -occurrence of at least one of the patterns {43512,34512,35412}. 

Proof. By Proposition 14.2.^ we know that c = for some k G new-rep(i(;). Choose the 
minimal such k\ that is, choose k so that w{k) < c (and thus, necessarily, w{j) > c for all 
j > fc + 1). There are now three places might appear relative to the letters {a, N,W{k), c}, 
which themselves form an A^-occurrence of 3412 in w. 



_^ a N w{k) ■ ■ ■ c = nik ■ ■ ■ ■ 

A4? A4? A4? 

By definition, > a. Thus, if 7^ a, then these three possibilities create iV-occurrences 
of 43512, 34512, or 35412 in w, respectively. □ 

Proposition 4.2.6. Suppose w avoids the patterns 

{45231, 45132, 43512, 34512, 35412}. 

// any N -occurrence {a, A^, 6, c} of 3412 in w is such that there exists no k E ne\N-rep{w) 
with {a,b,c) = {Mk,w{k),mk), then w has an N -occurrence of at least one of the patterns 
{45123,45213}. 

Proof. By Propositions 14.2.41 and 14. 2. 5^ we know that (a, c) = {Mk,mk) for some k G 
new-rep (ti;). If b ^ w{k), then w{k) either lies between A^ and b, or between b and c = ruk. In 
fact, W{k) must lie to the right of b, because b < c = ruk = m.m{w{k + 1), . . . , W{n)}. We also 
know that w{k) < Mk = a. Therefore, since w is 45132-avoiding, the set {a,N,b,w{k),c} 
forms an A^-occurrence of either 45123 or 45213. □ 

Propositions 14.2.^ 14. 2. 5^ and 14.2.61 now imply the following result. 
Corollary 4.2.7. If w has no N -occurrences of the patterns 

{45231, 45132, 43512, 34512, 35412, 45123, 45213}, 
then every N -occurrence o/3412 in w is equal to pk{w) for some k G ne\N-rep{w) . 

This addresses the concern about undercounting the A^-occurrences of 321 and 3412 in w. 
Corollary 4.2.8. If w has no N -occurrence of any of the patterns in the set 

{45231, 45132, 43512, 34512, 35412, 45123, 45213}, 

then 

|new-rep(w;)| > [321;3412]^(w;). 
Proof. This follows from Corollaries 14.2.31 and 14.2.71 □ 
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4.3. Conclusions. We now combine tlie previous two subsections to draw tlie following 
conclusion. 

Corollary 4.3.1. If w has no N -occurrence of any of the patterns in the set $, then 

|new-rep(w)| = [321;3412]^(«;). 

In other words, if w has no N -occurrence of any of the patterns in the set then the map 
Cn of equation is a bijection. 



Proof. Combine the inequalities in Corollaries 14.1.31 and 14.2.81 



□ 



It is natural now to wonder about the implications of containing an A^-occurrence of a 
pattern in $. In fact, for each w containing an A^-occurrence of some (;/>€$, there is an 
iV-occurrence p</,(w) of either 321 or 3412 which is not equal to pk{w) or to p^{w) (as defined 
in Proposition I4.1.4P for any k, as is shown in the following table. In this table, the N- 
occurrence p^{w) will be written as a substring of (j), and will refer to those respective letters 
of the iV-occurrence of 6 in w. 



G $ 


P0H 


4321 


421 


34512 


3512 


45123 


4513 


35412 


3512 


43512 


3512 


45132 


4513 


45213 


4523 


53412 


532 


45312 


532 


45231 


4523 



Note that for 4321 G $, the subpattern 432 is also not equal to any pk{w). However, it could 
equal some p^(iy), so to avoid this possibility we set p432i(w) = 421. 



Proposition 4.3.2. Let w E &n be a permutation containing an N -occurrence of some 
pattern G Then p(f,{w) is not equal to pk{w) for any k G new-rep(w), nor to any p'^{w), 
as defined in Proposition \4-l-4\ That is, the injection of equation (jl]) is not surjective. 



Proof. This follows from the definitions of the patterns p</,(iy), pk{w), and 



□ 



This proposition has the following corollary. 
Corollary 4.3.3. Ifw has an N -occurrence of at least one of the patterns in the set $, then 



|new-rep(w)| < [321;3412] 



N 



W 



5. Proof of the main theorem 

Proof of Theorem \3.2[ We prove this by induction on the number of letters in a permutation. 

The result is easy to verify for small cases, so assume that the theorem holds for all 
permutations in &n for all n < N, and consider w E Define w G &n-i as in Section HI 
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Since — 1 < A^, we know that rep(u') is equal to [321;3412](u') if w avoids the patterns in 
the set $, and that rep{w) is less than [321;3412](w) if u; contains at least one pattern in $. 

Suppose first that w avoids the patterns in $. li w has no iV-occurrences of any of the 
patterns in $, then |new-rep(tf)| = [321;3412]^(i(;). Thus 

r-ep{w) = rep(u;) + |new-rep(i(;)| 

= [321;3412](lt;) + [321;3412]^(«;) = [321;3412]H. 

On the other hand, if w does have an iV-occurrence of at least one the patterns in $, then 
|new-rep(w)| < [321;3412]^(?i)), and so 

rep(w) = rep(lZJ) + |new-rep(iy)| 

< [321;3412](lt;) + [321;3412]^(m;) = [321;3412]H. 

Now assume that W does not avoid the patterns in $. If w has no A^-occurrences of any of 
the patterns in $, then \nevj-rep{w)\ = [321;3A12]j^{w) . Thus 

rep{w) = rep(l(J) + |new-rep('u;)| 

< [321;3412](lt;) + [321;3412]^(i(;) = [321;3412]H. 

On the other hand, if w does have an A^-occurrence of at least one the patterns in $, then 
|new-rep(zf)| < [321;3412]^(tf ), and so 

rep{w) = rep(l(J) + |new-rep('u;)| 

< [321;3412](m;) + [321;3412]^(«;) = [321;3412]H. 

This completes the proof. □ 

Definition 5.1. Consider a permutation w & &n. Let Iy(o) = w, and for i & {1, . . . , N — 1}, 

let wJ(j+i) = 

Corollary 5.2. // a permutation w & &n avoids every pattern in the set $, then the maps 
{Cn '■ n < N} define a bijection from the set {new- rep (!(;(«)) : z G {0, . . . , A^ — 1}} to the set of 
all 321- and 34:12-patterns in w. 

Additionally, the proof of Theorem 13.21 can be adapted to show the following. 

Corollary 5.3. For any permutation w, 

[321;3412](tt;) — rep(w) > \{r : w has an r-occurrence of a pattern in $}|. 

Acknowledgements 

Special thanks are due to Kari Ragnarsson for writing the Java code to compute examples 
and to confirm conjectures through &io. 

References 

[1] A. Bjorner and F. Brenti, Combinatorics of Coxeter Groups, Graduate Texts in Mathematics 231, 

Springer, New York, 2005. 
[2] N. Bourbaki, Groupes et Algebres de Lie, Chapitres IV-VI, Masson, Paris, 1981. 
[3] D. Daly, Reduced decompositions with one repetition and permutation pattern avoidance, preprint. 
[4] I. G. Macdonald, Notes on Schubert Polynomials, Laboratoire de combinatoire et d'informatique 

mathematique (LACIM), Universite du Quebec a Montreal, Montreal, 1991. 



14 



BRIDGET EILEEN TENNER 



[5] R. Simion and F. W. Schmidt, Restricted permutations, European J. Comhin. 6 (1985), 383-406. 

[6] N. J. A. Sloane, Online encyclopedia of integer sequences, published electronically at http://oeis.org. 

[7] R. P. Stanley, On the number of reduced decompositions of elements of Coxeter groups, European J. Com- 
hin. 5 (1984), 359-372. 

[8] B. E. Tenner, Database of permutation pattern avoidance, published electronically at 
http : //math . depaul . edu/bridget/patterns .html. 

[9] B. E. Tenner, Pattern avoidance and the Bruhat order, J. Comhin. Theory Ser. A 114 (2007), 888-905. 
[10] B. E. Tenner, Reduced decompositions and permutation patterns, J. Algehraic Comhin. 24 (2006), 263- 
284. 

Department of Mathematical Sciences, DePaul University, Chicago, IL 60614 
E-mail address: bridget@math.depaul.edu 



REPETITION IN REDUCED DECOMPOSITIONS 



BRIDGET EILEEN TENNER 



Abstract. Given a permutation w, we show that the number of repeated letters in a re- 
duced decomposition of w is always less than or equal to the number of 321- and 3412-patterns 
appearing in w. Moreover, we prove bijectively that the two quantities are equal if and only 
if w avoids the ten patterns 4321, 34512, 45123, 35412, 43512, 45132, 45213, 53412, 45312, 
and 45231. 

Keywords: permutation, reduced decomposition, pattern 



1. Introduction 

Permutations can be described in a variety of ways, including as a product of simple 
reflections and in one-line notation. These two were studied extensively by the author in |13] . 
and a means for translating properties of one presentation into properties of the other was 
given. The first of these presentations is most relevant to the generalized setting of Coxeter 
groups and the Bruhat order. There is a rich literature studying various properties of reduced 
decompositions, including [2] and [10]. The second of these presentations, one-hne notation, 
is primarily useful when discussing the notion of permutation patterns. This topic originated 
in work of Rodica Simion and Frank Schmidt jSj, and has become a popular subfield of 
combinatorics. 

Given any permutation w, one can calculate its length, and one can also calculate the 
number of distinct simple reflections that appear in any reduced decomposition of w. The 
difference between these two quantities, denoted rep{w) in this paper, would thus count the 
number of repeated letters in any reduced decomposition of w. These statistics are readily 
computed from the presentation of a permutation as a product of simple reflections. 

When written in one-line notation, one often looks at the patterns in (or not in) a per- 
mutation. In particular, one can count the number of distinct 321- and 3412-patterns in a 
permutation w, and this total will be denoted [321;3412](i(;) here. 

It was shown in previous work by the author that rep{w) = if and only if [321;3412](i(;) = 
[T2] . Additionally, Daniel Daly shows that rep{w) = 1 if and only if [321;3412](ty) = 1 g]. 
Other than these results, not much has been known about the quantity or type of repetition 
that might occur within a reduced decomposition of a given permutation. 

The ideal conclusion based on the results of [jL2j and [4j, that rep{w) and [321;3412](i(;) 
would always be equal, is not actually the case, as can be seen with rep(4321) = 3 and 
[321;3412](4321) = 4. However, the main result of this paper (Theorem 13.21) is that rep{w) is 
always less than or equal to [321;3412](w), and the two quantities are equal exactly when w 
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avoids each of the patterns 

{4321, 34512, 45123, 35412, 43512, 45132, 45213, 53412, 45312, 45231}. 

Moreover, in Corollary 15.31 we give a crude lower bound on the difference [321;3412](«;) — 
rep{w) when w contains some of the patterns listed above. 

In Section |2]of the paper, we introduce the necessary objects and terminology for this work. 
Section [3] suggests the relevance of the ten patterns listed above and states the main theorem, 
while the proof of this theorem is spread over Sections H] and |5l 

2. Definitions 

This section summarizes the primary objects studied in this work. More background on 
this material can be found in [2] and [5]. 

Let <Sn be the symmetric group on n elements. The group is generated by the simple 
reflections (also called adjacent transpositions) {si, . . . , where Si is the permutation 

interchanging i and i + 1, and fixing all other elements. These permutations satisfy the 
Coxeter relations 

sf = 1 for all i, 

SiSj = SjSi if \i — j\ > 1, and 

SiSi+iSi = Si+iSiSi+i for 1 < i < n - 2. 

We adopt the custom that SiW interchanges the positions of the values i and z + 1 in the 
one-line notation of w, and wsi interchanges the values in positions i and z + 1 in the one-line 
notation of w. 

A permutation w G &n can also be written in one-line notation as w = w{l)w{2) ■ ■ - win). 

Example 2.1. The permutation 3241 G ©4 maps 1 to 3, 2 to itself, 3 to 4, and 4 to 1. 

We have now described two substantially different presentations for permutations: products 
of simple reflections and one-line notation. A means of translating between these two, and of 
inferring properties of one from properties of the other, was given in [13]. 

Definition 2.2. If w = ■ ■ ■ Sj^^^j where £{w) is minimal, then ■ ■ ■ Si^(„) is a reduced 
decomposition of w. This i{w) is the length of w. 

The set of reduced decompositions of a permutation has been studied from several view- 
points, including connections to Young tableaux as described in [lOj. In this paper, we will 
study repetition among the letters in a reduced decomposition of a permutation. To that 
end, we make the following definition. 

Definition 2.3. Given a permutation w, the support of w is the set supp(tf ) of distinct letters 
appearing in a reduced decomposition of w. 

It is important to clarify why this definition is sound. 

Lemma 2.4. The set supp(t/;) is well defined. 

Proof. We must prove that the set of letters in a reduced decomposition of a permutation is 
independent of the particular reduced decomposition chosen as a representative. Any reduced 
decomposition of w can be obtained from any other by a series of Coxeter relations (|7] and 
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|14] . independently). These do not change the underlying set of distinct letters in the reduced 
decomposition, so the set supp(t(7) is well defined. That is, given any reduced decomposition 

supp(w;) = {si„...,SiJ. 

□ 

Example 2.5. Let w = 32154 G ©5. One reduced decomposition for w is S2S1S2S4, so 
supp(io) = {si, 52,54}. Note that S2S1S4S2 and S1S2S1S4 are also reduced decompositions for 
w, and they each yield the same set supp(w). 

The following statistics will be crucial in our proof of the main theorem. 

Definition 2.6. Fix w G ©„ and A; G {1, . . . , n — 1}. Let 

Mk{w) = max{ti)(l), . . . , w{k)} 

and 

inrikiw) = mm{w{k + 1), . . . , w{n)}. 
Lemma 2.7. For any w G ©„, the values of Mk{w) satisfy 

Mi{w) < M2H < Msiw) <■■■< Mn-i{w), 
and the values of mk{w) satisfy 

mi{w) < m2{w) < m^{w) < ■ ■ ■ < m„_i(to). 

We have strict inequality Mkiw) < Mk+i{w) exactly when w{k + 1) > Mkiw), and rrikiw) < 
mk+iiw) exactly when w{k + 1) < rrik+iiw). 

Proof. These inequalities follow immediately from the definitions of Mk{w) and mk{w). □ 
The next lemma is a consequence of the definition of the support of a permutation. 

Lemma 2.8. Fix a permutation w G ©„. The following statements are equivalent: 

• Sk e supp(w), 

. {w{l),...,w{k)}y^{l,...,k}, 

• {w{k + l),...,w{n)} ^ {k + l,...,n}, 

• Mk{w) > k, 

• mk{w) < k + 1, and 

• Mk{w) > mk{w). 

Proof. Suppose that Sk G supp(i(;). This means that Sk appears at least once in each reduced 
decomposition of which means that there is some inversion w{i) > w{j) in w, where 
i < k < j. Thus the set {w{l), . . . , w{k)} cannot equal {1, . . . , k}, and, equivalently, the set 
{w{k + 1), . . . , w{n)} cannot equal {k + 1, . . . , n}. Also equivalently, the set {w{l), . . . , w{k)} 
contains an element larger than k, and, equivalently, the set {w{k + 1), . . . ,w{n)} contains 
an element less than k + 1. 

If, on the other hand, Sk ^ supp(w), then there is no inversion such as described in the pre- 
vious paragraph. Therefore w{l) ■ ■ ■ w{k) is a permutation of {1, ... , k} and w{k + l) ■ ■ ■ w{n) 
is a permutation of {A; + 1, ... , n}. Thus Mk{w) = k and mk{w) = A; + 1. □ 
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In this paper, we will study the relationship between two statistics of a permutation. The 
first of these is related to the support of a permutation. 

Definition 2.9. Given a permutation w, let rep{w) be the quantity 
(1) rep{w) = i{w) — \supp{w)\. 

This quantity is so named because it counts the number of simple reflections in a reduced 
decomposition of w, when reading from one end to the other, which repeat previously seen 
letters. The fact that this latter description is well defined may not be immediately obvious, 
given that a permutation may have more than one reduced decomposition. However, this does 
not affect supp(ty), as shown by Lemma [2^ and so rep{w) is well defined, by equation ([1]). 

Example 2.10. Let w = 35412, where i{w) = 7 and supp(t(;) = {51,52,53,54}. Thus 
rep{w) = 7 — 4 = 3. Relatedly, one reduced decomposition for w is 52515352545352, and 
reading from left to right we encounter the repeated simple reflections which are marked in 



52 



525l53[S2j54[S3 

There are three such letters, so rep{w) = 3. 

The other statistic we will consider relates to permutation patterns. 

Definition 2.11. Let w G (3„ and p G &k for k < n. The permutation w contains the 
pattern p if there exist ii < ■ ■ ■ < ik such that w{ii) ■ ■ ■ w{ik) is in the same relative order as 
p{l) ■ ■ -pik), in which case w{ii) ■ ■ ■w{ik) is an occurrence of p in w. For notational clarity, 
we will sometimes denote this pattern by {w{ii), . . . ,w{ik)}- If = max{u;(zi), . . . 
then this w{ii) ■ ■ ■w{ik) is an N -occurrence of p. If w does not contain p, then w avoids p, 
or is p- avoiding. 

The set of all occurrences of a pattern p in a permutation w can be partitioned by the 
largest letter appearing in the occurrence: 

{occurrences of p in w} = | |{A^-occurrences of p in w}. 

N 

Example 2.12. Continuing Example 12. 10[ there are two occurrences of 3412 in w: 3512 and 
3412. The first of these is a 5-occurrence, and the second is a 4-occurrence. The permutation 
w is 123-avoiding because it has no increasing subsequence of length 3. 

There is much interest in enumeration related to permutation patterns (see, for example, 
[31 |6l [8]). The portion of this scholarship relevant to the current work is the enumeration of 
occurrences of a pattern p appearing in a permutation w. 

Definition 2.13. Given a permutation vu and a pattern p, let [p];v('w) denote the number of 
A^-occurrences of p in it;. Let 

[p]H = E[p]^H 

N 

be the total number of occurrences of p in w. 

Example 2.14. Continuing Example I2.10[ we have [321]5(t«) = 2 and [321]^(w) = for all 
i ^ 5. Also, [3412]4(it;) = [3412]5(w;) = 1, and [3412].(it;) = otherwise. 
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For reasons that will be suggested by Theorem \2.17\ we are most concerned with the 
patterns 321 and 3412, and we will count the number of distinct occurrences of these patterns. 

Definition 2.15. Given a permutation w, 

[321;3412]^(^i;) = 

Let [321;3412](iy) be the quantity 

(2) [321;3412]H = 

Example 2.16. Continuing Example l2.10t let us calculate [321;3412](t(;). The distinct occur- 
rences of 321 in w are {541, 542}, and the distinct occurrences of 3412 in w are {3512, 3412}. 
Thus 

[321;3412]4H = + 1 = 1, 
[321;3412]5(\t;) = 2 + 1 = 3, and 
[321;3412](«;) = 2 + 2 = 1 + 3 = 4. 

Using the notation defined above, the following results were shown previously, the first by 
the author and the second by Daniel Daly. 

Theorem 2.17 ([T2] and P]). For any permutation w, 

(a) rep(«;) = if and only if [321;3412](t(;) = 0, and 

(b) rep(«;) = 1 if and only if [321;3A12]{w) = 1. 

Theorem 12. 171 gives a clear indication that the statistic rep is related to whether a permu- 
tation contains the patterns 321 or 3412. This arises from the previously mentioned work by 
the author in [13], relating patterns (and hence the one-line presentation of a permutation) 
with the presentation of a permutation as a product of simple reflections. 

The statistics rep and [321;3412] are not always equal, as shown by Examples l2.1Ul and l2.161 

rep(35412) < [321;3412](35412). 

In this paper, we will show that rep{w) never exceeds [321;3412](t(;), and we will characterize 
equality of the two quantities by pattern avoidance. 

3. The main theorem 

Rather surprisingly, the potential equality of the statistics rep and [321;3412] mentioned at 
the end of the last section depends solely on the avoidance of ten patterns, the set of which 
we will denote $. 

Definition 3.1. Let 

$ = {4321,34512,45123,35412,43512,45132,45213,53412,45312,45231} C (64 U ©5)- 

Note that the subset {34512,45123,35412,43512,45132,45213,53412,45312,45231} C $ 
can be expressed as the single marked mesh pattern 



and a positive integer A^, let 
[321]^H + [3^12Uw). 

-- [321] («;) + [3412] («;) 
- 5^[321;3412]^H. 
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where the marking of this region is 1, as indicated. The reader is referred to p~5] for more 
information about these objects. 

To suggest the relevance of the set $, let us compare rep(0) and [321;3412](0) for all 
writing rep(</)) as the difference i{4>) — |supp((/))|, and [321;3412](0) as the sum [321](0) + 
[3412]((/)) in equation 



e $ 


rep(0) 


[321;3412]((/)) 


4321 


6 


-3 = 


3 


4 + = 4 


34512 


6 


-4 = 


2 


+ 3 = 3 


45123 


6 


-4 = 


2 


+ 3 = 3 


35412 


7 


-4 = 


3 


2 + 2 = 4 


43512 


7 


-4 = 


3 


2 + 2 = 4 


45132 


7 


-4 = 


3 


2 + 2 = 4 


45213 


7 


-4 = 


3 


2 + 2 = 4 


53412 


8 


-4 = 


4 


4+1 = 5 


45312 


8 


-4 = 


4 


4+1 = 5 


45231 


8 


-4 = 


4 


4+1 = 5 



Observe that for each G $, we have r'ep{(f)) < [321;3412](0). 
We are now able to state the main theorem of the paper. 

Theorem 3.2. // a permutation w avoids every pattern in the set $, then 

rep{w) = [321;3412]H. 

Otherwise, 

rep{w) < [321;3412]H. 

This characterization of equality between rep and [321;3412] if and only if the set $ is 
avoided is recorded in entry P0022 of the Database of Permutation Pattern Avoidance [11] , 
and is enumerated by A191721 in [9]. 

Observe that Theorem 13.21 recovers the result in Theorem 12.171 since a permutation w in 
which [321;3412](w) G {0,1} necessarily avoids every pattern in Note also that and 1 
are the only values for which rep{w) and [321;3412](t(;) are always equal, because there are 
permutations G $ with rep(0) = 2 but [321;3412](0) = 3. 

Suppose w G ©AT. Theorem 13.21 is proved by induction on and involves an assignment of 
at least one A^-occurrence of 321 or 3412 to each previously used letter involved in positioning 
N in the one-line notation of w, after first positioning all other letters relative to each other. 
We must be wary of overcounting these A-occurrences of 321 and 3412. The details of the 
proof are covered in Sections H] and [51 
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4. Preliminaries for proving the main theorem 

4.1. Notation and elementary results to be used in the proof. 

Definition 4.1.1. Consider w E &n- Define w G &n-i by 

—/ ■\ 1 '"'(^) iii<w^^(N), and 
wit) = \ 

+ ifi>w-\N). 

The one-line notation of w is obtained from tlie one-line notation of w by deleting the letter 
and sliding all subsequent letters one space to the left. Moreover, if we think of w as a 
permutation in ©a? that fixes A^, then 

(3) W = WSn-1SN-2- ■ ■ Stu-i(N), 

and 

e{w) = i{w) + N -w-\N). 

Example 4.1.2. If w = 35412, then w = 3412. If we consider w to be the element 34125 G 
©5, then 

W = WS4S3S2- 

One reduced decomposition of w is S2S1S3S2, and so S2S1S3S2S4S3S2 is a reduced decomposition 
of w. 

Throughout the rest of this section, let w he a permutation in &n, and w G &n-i be as 
defined above. 

The following set will be crucial in the proof of Theorem 13. 2[ describing the letters in a 
reduced word of w, but not of W, which count as repeated letters for w. 

Definition 4.1.3. Let ne\N-rep{w) = {fc : G supp(ly) and w^^{N) < k}. 

Lemma 4.1.4. 

rep(w) = rep{W) + \supp(W)n{sN-iSN~2---s^-^N)}\ 
= rep(lo) + |new-rep(w)|. 

Proof. This follows from equation ([3]). □ 

Recall the functions and m^, from Definition 12.61 

Lemma 4.1.5. Mk(w) > mk(w) and w~'^{N) < k if and only if k E new-rep(u7). 

Proof. The forward direction of the statement is immediate from the definition of new-rep(w). 
The converse of this follows from Lemma 12.81 and Definition 14.1.31 □ 

To show that rep{w) is a lower bound for [321;3412](t«), we would like to assign, to each 
element of ne\N-rep{w) , at least one A^-occurrence in w of one of the patterns {321, 3412}. This 
assignment should be done carefully to avoid overcounting. Additionally, to characterize when 
rep{w) and [321;3412](to) are equal, we would like to understand when each A^-occurrence in 
w of the patterns {321,3412} corresponds to some element of new-rep(ti'). 

For the remainder of this section, set Mk = Mkiw) and mk = rukiw) for all k. 

Definition 4.1.6. Consider k G new-rep(t(;). Define pk{w) as follows. 
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I. If w~^{N) < w~^{Mk), then pk{w) = {N, Mk,mk}, which is a 321-pattern in w. 
II. If w~^{N) > w~^{Mk) and w{k) > ruk, then pk{w) = {N,w{k),mf:}, which is a 
321-pattem in w. 

III. Otherwise, set pkiw) = {M^, N,w{k),mk}, which is a 3412-pattern in w. 
This pk{uj) is undefined if A; ^ new-rep(iy). 

Note that pkiw) is always an A^-occurrence of either 321 or of 3412 because k G ne\N-rep{w) 
and thus Mk > nik by Lemma [2.81 However, it is not clear when pk{w) and pk'{w) coincide 
for k 7^ k', nor which A^-occurrences of 321 or of 3412 have the form pkiw) for some k. 

4.2. Issues of overcounting. Consider whether the patterns pk{w) might overcount A^- 
occurrences of 321 or 3412 in w. 

Proposition 4.2.1. There are no distinct k, k' G nevj-repiyo) for which pk{w) and pk'{w) are 
the same N -occurrence o/3412 in w. 

Proof. If this were the case, then {Mk,w{k),mk) = {Mk',w{k'),mk'). But then w{k) = W{k'), 
implying that k = k' . □ 

Therefore, if there is any overcounting of A^-occurrences of 321 or 3412 among the {pk{w)}, 
it must be that pkiw) and pwiw) are the same A^-occurrence of 321. 

Proposition 4.2.2. // there exist distinct k,k' G ne\N-rep{w) with pk{w) = pk>{w), then w 
has an N -occurrence o/4321. 

Proof. Suppose that there exist k^k' G new-rep(iy), with k < k', such that pkiw) = pk'{w). 
Proposition 14.2.11 implies that these coincident patterns must be A^-occurrences of 321 in w. 

These coincident pfc(w) and pk'{w) cannot both be of type II as in Definition I4.1.6i because 
that would mean that w[k) = w{k'), and so A; = k'. 

Now suppose that the patterns have different types. Thus w{k) = Mk' and ruk = nik'- 
Then {N,w(k) = Mk' ,w{k'),mk = mk'} forms an A^-occurrence of 4321 in w. Note also in 
this case that we must have Mk = w{k) = Mk', since otherwise Mk would lie to the left of 
w{k) = Mk', and be greater than w{k) by definition, which would contradict the maximality 
of Mk'. 

It remains to consider the case when both patterns are of type I, and so {Mk,mk) = 
{Mk',mk') = {M,m). We can assume that M ^ {w{k),w{k')} because that case was already 
addressed. Then the one-line notation of w, and hence of w, looks like 

... ][f ... i[j(^k) ■ ■ ■ w{k') ■ ■ ■ m ■ ■ ■ . 

Consider where A^ lies in relation to the values {M,w{k),w{k'),m]. Because both patterns 
have type I, we must have that w~^{N) < w~^{M), and so A^ lies to the left of M. The 
definitions of M and m require that M > W{k),w{k'), and m < w{k'). Thus the letters 
{A^, M,w{k'), m} form an A^-occurrence of 4321. □ 

Corollary 4.2.3. If w has no N -occurrence o/4321, then 

|new-rep(^i;)| < [321;3412]^H. 

Proof. This follows from Propositions 14.2.11 and I4.2.2[ because there do not exist distinct 
k,k' G n&N-repiw) with pkiw) equalling pk'iw). □ 
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Therefore, by Corollary 14.2.31 the procedure for assigning to each k G ne\N-rep{w) an A^- 
occurrence of either 321 or 3412 is injective if w has no A^-occurrence of 4321. We must now 
consider what happens to this assignment when w does have such a pattern. 

Proposition 4.2.4. Suppose that w has an N -occurrence o/4321. 

(a) // there exist distinct k, k' G new-rep(tf) and pk{w) = pk'{w), then there are two other 
N-occurrences pkiiw) and p^'i^) of 321 in w, which are not equal to pj{w) for any j. 
(Let such a k' he called '^duplicating.") 

(b) Let i and j both he duplicating. If i ^ j , i/ien {p^(w), pj~('u;)} fl {p^(tf ), pj(iy)} = 0. 

Proof. First we will prove statement (a). Suppose that there are such k < k' . Then we 
know from Proposition 14.2.21 that {Mk,mk) = {Mki^rriki) = {M,m), and pk{w) = pk'iw) = 
{N, M, m}. Also, we know that the one-line notation of w looks like 

... N ■■■ M ■■■ w{k) ■ ■ ■ w{k') ■■■ m ■■■ , 

where M and w{k) could possibly be equal. Because M = M^/, we must have M > w{k'). 
Also, because m = ruk, we must have m < w{k'). Thus 

(4) pI,{w) = {N > M > w{k')} and p^,{w) = {N > w{k') > m} 

are both A^-occurrences of 321 in w. 

Note that pfc/(w) is not equal to pj{w) for any j, because id{k') is not equal to ruj for any j: 
there exists a letter (for example, m) to the right ofW{k') which is less than w{k'). Similarly, 
py{w) 7^ pj{w) for any j, because w{k') cannot equal Mj. 

The proof of statement (b) is similar to the previous argument. Suppose that i and j are 
duphcating, with i ^ j. If p'liw) = p~j'{w) or p~{w) = p~{w), as defined in equation (jl]), 
then w{i) = w{j). This would mean that i = j, which is a contradiction. Thus it remains 
to consider the situation pt{w) = pj{w). Then Mj = w{j) and W{i) = rrij, and i > j. Once 
again, we cannot have w{i) = mj, because the letter nii appears to the right of w{i) and is 
less than w{i). This completes the proof. □ 

Corollary 4.2.5. If w has an N -occurrence o/4321, then 

|new-rep(w)| < [321;3412]^(u)). 

Proof. Partition the set x\e\N-rep{w) into sets 5*1, 5*2, . . . , S'^ so that {Mk.rrik) = {M{i),m{i)) 
for each k G Si. Suppose Si = {fcjj < ki^ < ■ ■ ■ < h^^^}, and define 

P5, (w) = \pk,^ {w),pI (w),p^(w), . . . ,pI (w), Pfc^ ^iw)]. 

Note that if \Si\ = 1, then Ips.Ml = 1- Also, if \Si\ > 1, then \pSiM\ = 2|5'i| - 1 > \Si\. 
Moreover, the elements of p5j(w) are all A^-occurrences of either 321 or 3412 in w. Finally, 
by Proposition 14.2.4( b). the sets {p^. (ti?)} are disjoint. 

If w has an A^-occurrence of 4321, then there exists some Si containing at least two ele- 
ments. Thus \nevj-rep{w)\ = \Si\ + \S2\ ^ ^ \St\ < \psAw) \ + \pS2{u!) \ H h IpsMl < 

[321;3412]^(«;). □ 
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Using the notation from the proof of Corollary I4.2.5[ we can also rewrite its result to say 
that the map 



(5) Cn-j^ 



is an injection. 



pj{w) if j is the minimal element in Si, and 
p^{w) otherwise. 



4.3. Issues of undercounting. We have now addressed the issue of whether the set {pk{w) : 
k G new-rep('u;)} might overcount some A^-occurrences of 321 or of 3412 (in fact, we have 
shown that only 321-patterns may be overcounted). We must now consider when this set 
might undercount these A^-occurrences. As we have seen in Proposition 14. 2. 4^ undercounting 
is certainly a possibility. What we will show now is that if w avoids the ten patterns in the 
set then there is no undercounting, and thus the inequality of Corollary 14.2.31 is actually 
an equality. 

To examine potential undercounting, we must decide if and when an A^-occurrence of 321 
or of 3412 might not equal pk{w) for some k. 

Proposition 4.3.1. // any N -occurrence {N > a > h] of 321 in w is such that b ^ {nik '■ 
k G new-rep (w)}, then w has an N -occurrence o/4321. 

Proof. Suppose there is an A^-occurrence of 321 in w where b ^ rrik for any k. Then to the 
right of b in the one-line notation w, there exists c < b, preventing b from equalling any such 
nik- Thus {A^ > a > 6 > c} is an A^-occurrence of 4321. Now, suppose there is no such c, 
and set k = w~^{b) — 1. Then b = nik, and, since a > b appears to the left of b, we must have 
Mk > a > b = m^. Therefore, by Lemma [4.1.51 k G new-rep(u;). □ 

Proposition 4.3.2. Suppose w is 4:321 -avoiding. If any N -occurrence {N > a > b} of 321 
in w is such that there exists no k ^ nevj-rep{w) with (a, 6) G {(Mfc,mfc), (Wk,mk)}, then w 
has an N -occurrence of at least one of the patterns {45312, 53412}. 

Proof. By Proposition 14.3. ll we know that b = rrik for at least one value of A; G new-rep('u;). 
Suppose that a ^ {Mk,w{k)}. 

Suppose a > Mk. Then, by maximality of M^, this a must appear to the right of both Mk 
and w{k) in the one-line notation of w. But then, setting k' = w~^{a), we must have m^/ = 
ruk = b, and so (a, 6) = (W{k') , ruk') ■ By definition, k' > k, and so ruk' = < fc + l < /c' + l, 
where the first inequality is because k G new-rep (t/;). Therefore k' G new-rep (tf) as well, by 
Lemma 14.1.51 

Now suppose that a < Mk. If w^^{N) > w^^{Mk), then the one-line notation of w looks 
hke 

• • • Mfc ■ ■ ■ N ci b = rrik • • • , 

<a >a or <mk 

because w is 4321-avoiding. If all values appearing between a and b in w are larger than a, 
then we can set k' = w~^{a), and we have (M^/, nik') = {Mk, nik), and again k' G new-rep (to) 
by Lemma [4.1.51 Thus suppose that there is some value c in this portion of w with c < ruk- 
Then {Mk, N, a, c, b} is an A^-occurrence of 45312 in w. 
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Finally, suppose that w ^{N) < w ^(M^), where k is minimal with this property. So the 
one-line notation of w looks like 

■ ■ ■ ■ ■ ■ a ■ ■ ■ Mk ■ ■ ■ b = irtk ■ • ■ , 

again because w is 4321-avoiding. If = w{k), then the value of k was not chosen to be 
minimal, a contradiction. Thus the entry w{k) must lie strictly between and b = m^. By 
definition, w{k) < Mk- Moreover, to avoid the pattern 4321, we must have w{k) < b = mk. 
Thus {A^, a, Mk,w{k), b = nik} forms a 53412-pattern in w. □ 

Propositions I4.3.T] and 1^3.21 now imply the following result. 

Corollary 4.3.3. Ifw has no N -occurrences of the patterns {4321,45312,53412}, then every 
N -occurrence of 321 in w is equal to pk{w) for some k. 

Proposition 4.3.4. // any N -occurrence {a, A^, 6, c} o/3412 in w is such that c ^ {rrik : k G 
new-rep(w)}, then w has an N-occurrence of at least one of the patterns {45231,45132}. 

Proof. Suppose there is such an A^-occurrence of 3412 in w. This means that to the right of 
c in the one-line notation of w, there exists a d < c, preventing c from equalling any such 
rufc. Thus {a, N, b, c, d} is an A^-occurrence of either 45231 or of 45132, depending on whether 
b > d or b < d. Now suppose that there is no such d, and set k = w~^{c) — 1. Then c = m^, 
and, since a > c appears to the left of c, we must have Mk > mk. Therefore, by Lemma 14.1.51 
k E ne\N-rep{w) . □ 

Proposition 4.3.5. Suppose w is 45231- and 45132- avoiding. If any N-occurrence {a, N, b, c} 
of 3412 in w is such that there exists no k E new-rep(t/;) with (a, c) = {Mk,mk), then w has 
an N-occurrence of at least one of the patterns {43512,34512,35412}. 

Proof. By Proposition I4.3.4| we know that c = for some k G ne\N-rep{w). Choose the 
minimal such k; that is, choose k so that w{k) < c (and thus, necessarily, w{j) > c for all 
j > k + 1). There are now three places Mk might appear relative to the letters {a, N,W{k), c}, 
which themselves form an A^-occurrence of 3412 in w: 

^^^—jj^ a N w{k) ■ ■ ■ c = mk ■ ■ ■ • 

A4? Affc? Affc? 

By definition, Mk > a. Thus, if Mk 7^ a, then these three possibilities create A^-occurrences 
of 43512, 34512, or 35412 in w, respectively. □ 

Proposition 4.3.6. Suppose w avoids the patterns 

{45231, 45132, 43512, 34512, 35412}. 

// any N-occurrence {a, N, b, c} of 3412 in w is such that there exists no k E new-rep('u;) 
with {a,b,c) = {Mk,w{k),mk), then w has an N-occurrence of at least one of the patterns 
{45123,45213}. 

Proof. By Propositions 14.3.41 and I4.3.5[ we know that (a, c) = {Mk,mk) for some k G 
new-rep (ly). lib ^ w{k), then w{k) either lies between A^ and b, or between b and c = mk. In 
fact, W{k) must lie to the right of b, because b < c = mk = m.m{w{k -|- 1), . . . ,W{n)}. We also 
know that W{k) < Mk = a. Therefore, since w is 45132-avoiding, the set {a, N,b,w{k),c} 
forms an A^-occurrence of either 45123 or 45213. □ 
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Propositions 14.3.^ 14.3 .St and 14.3.61 now imply the following result. 
Corollary 4.3.7. If w has no N -occurrences of the patterns 

{45231, 45132, 43512, 34512, 35412, 45123, 45213}, 
then every N -occurrence o/3412 in w is equal to pfc(to) for some k G new-rep(u;). 

This addresses the concern about undercounting the A^-occurrences of 321 and 3412 in w. 
Corollary 4.3.8. If w has no N -occurrence of any of the patterns in the set 

{4321, 45312, 53412, 45231, 45132, 43512, 34512, 35412, 45123, 45213}, 

then 

|new-rep(^i;)| > [321;3412]^(w). 
Proof. This follows from Corollaries 14.3.31 and I4.3.7[ □ 

4.4. Conclusions. We now combine the previous two subsections to draw the following 
conclusion. 

Corollary 4.4.1. If w has no N -occurrence of any of the patterns in the set $, then 

|new-rep(w)| = [321;3412]^(u)). 

In other words, if w has no N -occurrence of any of the patterns in the set $, then the map 
Cn of equation is a bijection. 

Proof. Combine the inequalities in Corollaries 14.2.31 and 14.3.51 □ 

It is natural now to wonder about the implications of containing an A^-occurrence of a 
pattern in $. In fact, for each w containing an A^-occurrence of some G $, there is an 
A^-occurrence p(f,{w) of either 321 or 3412 which is not equal to pk{uj) or to (if) (as defined 
in Proposition 14.2.41) for any k, as is shown in the following table. In this table, the A^- 
occurrence p(f,{w) will be written as a substring of (j), and will refer to those respective letters 
of the A^-occurrence of <p in w. 



G $ 


P0H 


4321 


421 


34512 


3512 


45123 


4513 


35412 


3512 


43512 


3512 


45132 


4513 


45213 


4523 


53412 


532 


45312 


532 


45231 


4523 



Note that for 4321 G $, the subpattern 432 is also not equal to any pk{w). However, it could 
equal some p^(w), so to avoid this possibility we set p432i(w) = 421. 
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Proposition 4.4.2. Let w G &n be a permutation containing an N - occurrence of some 
pattern G $. Then p4,{w) is not equal to pkiw) for any k G new- rep (w) , nor to any p'l{w), 
as defined in Proposition \4-^-4\ That is, the injection ^jy of equation is not surjective. 



Proof. This follows from the definitions of the patterns p(j,{w), pk{w), and p^{w). □ 

This proposition has the following corollary. 
Corollary 4.4.3. If w has an N -occurrence of at least one of the patterns in the set then 

|new-rep(«;)| < [321;3412]jv(w;). 

5. Proof of the main theorem 

Proof of Theorem \3.2 . We prove this by induction on the number of letters in a permutation. 

The result is easy to verify for small cases, so assume that the theorem holds for all 
permutations in (5„ for all n < N, and consider w & &n- Define w G &n-i as in Section HI 
Since — 1 < A^, we know that rep(W) is equal to [321;3412](u/) if w avoids the patterns in 
the set $, and that rep{w) is less than [321;3412](tZJ) if contains at least one pattern in $. 

Suppose first that w avoids the patterns in $. If w has no A^-occurrences of any of the 
patterns in $, then \nevj-rep{w)\ = [321;3A12]j^{w) . Thus 

rep{w) = rep(uJ) + |new-rep(iy)| 

= [321;3412](«;) + [321;3412]^(m;) = [321;3412]H. 

On the other hand, if w does have an A^-occurrence of at least one the patterns in $, then 
|new-rep(w)| < [321;3412]^(iy), and so 

rep{w) = rep(«;) + | new-rep (if)! 

< [321;3412](lt;) + [321;3A12] j^{w) = [321;3412]H. 

Now assume that w does not avoid the patterns in $. li w has no A^-occurrences of any 
of the patterns in then | new-rep (to) | = [321;3412]^(tf ). Thus inequality holds. On 
the other hand, if w does have an A^-occurrence of at least one the patterns in $, then 
|new-rep(w)| < [321;3412]^(iy), and so inequality ([6]) holds again. 

This completes the proof. □ 

Definition 5.1. Consider a permutation w E &n- Let I(J(o) = w, and for i G {1, . . . , A^ — 1}, 

let uJ(i+i) = 

Corollary 5.2. // a permutation w E &n avoids every pattern in the set $, then the maps 
{Cn '■ n < N} define a bijection from the set {new- rep {w^i)) : i G {0, . . . , N — 1}} to the set of 
all 321- and 3A12-patterns in w. 

Additionally, the proof of Theorem 13.21 can be adapted to show the following. 

Corollary 5.3. For any permutation w, 

[321;3412](to) — rep{w) > \{r : w has an r-occurrence of a pattern in $}|. 
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Using fT] and the MAPLE package [16], Vince Vatter has subsequently found a generating 
function for the number of permutations in ©tv avoiding the ten patterns in $ [T7]. This 
generating function is 

^ ^ 1 — Ax + 

(1 — x){l — Ax — x'^ + x^) 
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